Collecting and assessing collaborative requirements

Within evaluation frameworks such as the CLEF evaluation platform, many people are involved in different evaluation tasks such as organizing the task, creating topics, managing document collections, and handling different participants and submission. It also includes the selection of measures and run the final evaluations. In some of these stages of the evaluation process, there may be a need for collaborative information handling procedures. In order to identify some of the needs and requirements for collaboration, we investigated three different domains. This paper presents identified needs for collaborative activities that may occur within an interactive evaluation platform such as in the European Promise (Participative Research labOratory for Multimedia and Multilingual Information Systems) project. Following a user centered design, collected requirements have been assessed using a realistic mock-up scenario. General Terms Documentation, Design, Experimentation